Signal detection, modularity and the correlation between extrinsic and intrinsic noise 

in biochemical networks 
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Understanding cell function requires an accurate description of how noise is transmitted through 
biochemical networks. We present an analytical result for the power spectrum of the output signal 
of a biochemical network that takes into account the correlations between the noise in the input 
signal (the extrinsic noise) and the noise in the reactions that constitute the network (the intrinsic 
noise). These correlations arise from the fact that the reactions by which biochemical signals are 
detected necessarily affect the signaling molecules and the detection components of the network 
simultaneously. We show that anti-correlation between the extrinsic and intrinsic noise enhances the 
robustness of zero-order ultrasensitive networks to biochemical noise. We discuss the consequences of 
the correlation between extrinsic and intrinsic noise for a modular description of noise transmission 
through large biochemical networks in the context of the mitogen-activated protein kinase cascade. 



Living cells process information in a stochastic man- 
ner [1110,11113,11113111111113 It it generally 
believed that biochemical noise can be detrimental to cell 
function, because it can hamper the reliable integration 
and transmission of signals jl4l | . It is increasingly becom- 
ing recognized, however, that stochasticity can also play 
a beneficial role • Biochemical noise can enhance the 
functioning of biochemical networks by, e.g., increasing 
the sensitivity [T^ or by driving oscillations |l7l |. while 
stochastic switching between phenotypes can increase the 
proliferation of an organism in a randomly fluctuating en- 
vironment 0, ^1 . It is thus important to understand 
how living cells process noisy signals. The complete bio- 
chemical network of a living cell consists of a huge number 
of biochemical reactions. This precludes a detailed meso- 
scopic description of the propagation of noise through the 
full network. However, it is believed that biochemical 
networks are modular in design, which means that they 
can be decomposed into smaller, functionally indepen- 
dent units ^2Q„ .21,] . This is potentially useful, because it 
would make it possible to coarse-grain the full network 
of individual reactions to a smaller network consisting of 
modules, where each module is described as a 'black box' 
with input and output signals; the reactions that con- 
stitute each module would then be integrated into the 
input-output relations [2II . This would allow a simplified 
description of the behavior of the full network |23, [111 . 
It is not clear, however, whether such a description is 
possible for the transmission of noise. Here we address 
the question: under which conditions can modularity be 
exploited to develop a coarse-grained description for the 
transmission of noise? 

Recently, several groups have derived analytical ex- 
pressions for the noise in the output signal of a network 
as a function of the noise in the input signal, known 
as the "extrinsic noise", and the noise in the biochem- 
ical reactions that constitute the network, the "intrin- 
sic noise" [H [H [H [l^. These results suggest that 
the input-output relations for the noise of the individual 



modules of a network can be combined in a simple way to 
quantify the transmission of noise through the full net- 
work [23I [3, [13' However, these studies assume that 
the extrinsic and intrinsic noise arc independent sources 
of noise [23. 123. 125ll2^ . Here, we show that the biochem- 
ical reactions that allow a module to detect the incoming 
signals introduce correlations between the fluctuations in 
the input signals and the intrinsic noise of the processing 
module; the extrinsic and intrinsic noise are not therefore 
independent of one another. This means that the fluctu- 
ations in the output signal of one module (which depend 
upon the intrinsic noise of that module) can affect the 
intrinsic noise of another module. As a consequence, the 
modules do not perform independently of one another 
and this, in general, impedes a quantitative modular de- 
scription of the propagation of noise through large scale 
biochemical networks. Our analysis also reveals the con- 
ditions under which detection reactions do not introduce 
correlations between the extrinsic and intrinsic noise; un- 
der these conditions, a modular description of noise trans- 
mission can be developed. 

We study the consequences of the correlations between 
extrinsic and intrinsic noise for the mechanism of zero- 
order ultrasensitivity |27j . Zero-order ultrasensitivity 
is one of the principal mechanisms that allow cells to 
strongly amplify input signals [2I [2^. It operates in 
push-pull networks, which are ubiquitous in prokaryotes 
and eukaryotes. In a push-pull network, two enzymes co- 
valently modify a component in an antagonistic manner, 
e.g., a kinase that phosphorylates a component and a 
phosphatase that dcphosphorylates the same component 
(see Fig. . If both enzymes operate near saturation, 
then the modification and demodification reactions will 
be zero-order, which means that their reaction rates be- 
come insensitive to the substrate concentrations. Under 
these conditions, a small change in the concentration of 
one of the two enzymes, will lead to a large change in 
the concentration of the modified protein. Zero-order 
ultrasensitivity thus allows push-pull networks to turn 
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a graded input signal (the concentration of one the en- 
zymes) into a nearly binary output signal (the covalently 
modified protein) |27ll28l |. However, if the enzymes oper- 
ate near saturation, then these networks are also known 
to exhibit large intrinsic fluctuations ■ This will not 
only weaken the sharpness of the macroscopic response 
curve , but will also strongly limit the detectability of 
the input signal Moreover, large extrinsic fluctua- 

tions in, e.g., the activity of the kinase, can induce bista- 
bility in the network [30j. In order to understand the 
performance of zero-order ultrasensitive networks, it is 
therefore important to understand not only their macro- 
scopic input-output curves, but also their noise charac- 
teristics. 

The noise properties of zero-order ultrasensitive net- 
works have been studied extensively [2^ |2^ |2^ l30l |. 
However, all these studies have ignored the correlations 
between the extrinsic and intrinsic noise: the modifica- 
tion and demodification reactions were assumed to be 
given by Michaelis-Mention kinetics without explicitly 
taking into account the binding and unbinding of the en- 
zymes to their substrates ^^.2^^, 3i]J- Here, we show 
that the (un)binding of the enzymes to their substrates 
induces anii-correlations between the extrinsic noise ~ 
the fluctuations in the activating enzyme - and the in- 
trinsic noise - the fluctuations in the modification and 
demodification reactions. These anti-correlated fluctu- 
ations reduce the noise in the output signal (the cova- 
lently modified protein). While it has long been known 
that temporal fluctuations in the network components 
can adversely affect the performance of zero-order ultra- 
sensitive networks , our calculations reveal that 
anti-correlated fluctuations between different sources of 
noise can, in fact, enhance their performance by increas- 
ing the signal-to-noise ratio. 

Finally, we illustrate the consequences of the correla- 
tions between extrinsic and intrinsic noise for a modular 
description of noise propagation using the MAPK cas- 
cade. This network is an important intracellular signal- 
ing pathway in eukaryotes, where it plays a central role in 
cell pro liferation, cell differentiation, and cell cycle con- 
trol [23 . The MAPK cascade consists of three push-pull 
modules connected in series (see Fig.nj. We find that be- 
cause of the correlations, the modules no longer perform 
independently of one another. As a result, an iterative 
application of noise- input-output relations of the individ- 
ual modules drastically overestimates the propagation of 
noise. Only by analyzing the modules together at the 
level of the individual biochemical reactions do we arrive 
at the correct result. 

The noise properties of genetic networks in both 
prokaryotes H 0,11 EH and eukaryotes 0, H ES 111 [H 
have been measured. While noise in signaling pathways 
has been studied to some extent in prokaryotes [131 , noise 
in eukaryotic signaling networks has not yet been exper- 
imentally investigated. Our results provide a general, 
quantitative framework for describing the transmission 
of noise in gene regulatory networks and signal transduc- 



tion pathways. 

I. NOISE ADDITION RULE: UNCORRELATED 
EXTRINSIC AND INTRINSIC NOISE 

We consider a module with one input and one output 
signal. We imagine that the module is a 'black box': 
we will not therefore consider the biochemical reactions 
that constitute the module explicitly. Clearly, in general, 
the incoming signal could be transformed into the outgo- 
ing signal in a complicated manner, depending upon the 
reactions that form the module. We imagine, however, 
that the system is in steady state and we assume that the 
fluctuations of the incoming and outgoing signals around 
their steady-states values are small; this allows us to lin- 
earize the coupling between them and to use the linear- 
noise approximation [3ll |. Moreover, we will here assume 
that the noise in the input and output signals is uncor- 
related and that the output signal relaxes exponentially 
with decay rate /x. This yields the following chemical 
Langevin equation for the output signal 

X ~ V s(t) — fix + ri{t) . (1) 

Here, s = S — (S) is the deviation of the number of signal- 
ing molecules, S, from its mean, (5), and x ^ X — (X) 
is the corresponding quantity for the output signal; v 
corresponds to the differential gain and the dot denotes 
a time derivative. The last term, ry(t), describes the 
fluctuations in the reactions that constitute the process- 
ing unit; we repeat that we make the crucial assump- 
tion that this is uncorrelated from the input signal s{t). 
We model ri{t) as Gaussian white noise: {r]{t)) = and 
{'ri{t)r]{t')) = a^S{t — t'). By taking the Fourier transform 
we obtain the power spectrum Sx for the the outgoing 
signal: 

5x(c.) = (|5;-(^)p) = + ^^Ssiu;), (2) 

where af^ — af^/{2^) is the intrinsic noise and S's(w) = 
(|s(a;)p) is the power spectrum of the incoming signal. A 
similar expression has been obtained recently j2^l26ll3^ . 
We refer to Eq. |2as the spectral addition rule. 

Eq. 121 has the attractive interpretation that the com- 
putational module acts as a low-pass filter for the input 
noise (second term) and generates its own noise in the 
process (first term); the filter function + (jj'^) fil- 

ters the high-frequency components in the input signal. 
Moreover, in this model, the effects are additive: the in- 
trinsic noise is simply that which would arise if the input 
signal did not fluctuate; conversely, the extrinsic noise is 
not affected by the intrinsic noise. The spectral addition 
rule is a consequence of the linear response of x to the 
sum vs{t) -|- •q{t) (Eq. ^1, and the assumption that s(t) 
and 77 (t) are uncorrelated. 

If the autocorrelation function for the noise in the in- 
coming signal has an amplitude and decays exponen- 
tially with a relaxation rate A, then its power spectrum 
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FIG. 1: The Mos/MEK/p42 MAPK cascade. This network consists of three tiers, which, from a topological point of view, could 
be regarded as modules. Note also that the full network consists of push-pull networks, in which the activity of an enzyme is 
covalently modified by the action of two opposing enzymes. 



is given by 



^s(^) 



A2 



(3) 



In this case, the total noise in the outgoing signal, 
V(27r) X!^ dhjSy^{uj), is given by 
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(5)2 X + fi' 



(4) 



Here, a^^ is the extrinsic noise and 5 = d\n{X) /d\n{S) — 
{v/ ^jl) {S)/{X) is the logarithmic gain. This relation has 
been derived recently by Paulsson and Shibata and 
Fujimoto [23. We refer to Eq. 0] as the noise addition 
rule. It is only valid if the incoming signal has a single 
exponential relaxation time and if the spectral addition 
rule, Eq. 121 holds, which means that the incoming signal 
and the intrinsic noise must be uncorrelated. 

Eqs.|21and2|are potentially powerful relations, because 
they allow a modular description of noise propagation. If, 
for instance, the network consists of a number of mod- 
ules connected in series, then, once the intrinsic noise for 
each of the individual modules is known, the propaga- 
tion of noise through the network can be obtained for 
arbitrarily varying input signals by the recursive applica- 
tion of the spectral addition rule, Eq.|21 to the successive 
modules [23, ^M'y noise strength of the output sig- 
nal of the network could then be obtained by integrating 
over its power spectrum. However, this approach requires 
that the spectral addition rule holds for each of the indi- 
vidual modules. Below, we will show that the detection 
reactions can introduce correlations between the extrin- 
sic and intrinsic noise. These correlations lead to a break 
down of the spectral addition rule, impeding a quanti- 
tative modular description of the transmission of noise 
through large networks. 



II. CORRELATED EXTRINSIC AND 
INTRINSIC NOISE 



To elucidate the origin of the correlations between the 
extrinsic and intrinsic noise, it will be instructive to con- 
sider a module that consists of one component only. This 
component, X, both detects the input signal S and pro- 
vides the output signal. In the next section we will gener- 
alize our results and discuss more complex modules. To 
capture the correlations between the extrinsic and intrin- 
sic noise, we explicitly describe the detection of the signal 
by studying the coupled Langevin equations for the two 
interacting species - the signaling molecules S and the 
detection molecules X; only by analyzing the input sig- 
nal and the processing module together, do we arrive at 
the correct results. 

The most general form of the two coupled chemical 
Langevin equations is 



S = —As + KX + ^(t), 

X — vs — ^.x + rj{t). 



(5a) 
(5b) 



Here, k describes how the number of signaling molecules 
is directly affected by the number of (active) detection 
molecules and ^(t) models the noise in s; the noise terms, 
^(t) and rj{t)^ are modeled as correlated Gaussian white 
noise: m) = ivit)) = 0, mm) = {e)Sit t'), 
mnit')) = {r,^)S{t - t') and mv{t')) = {^iW 
t'). The pair of linear differential equations in Eq. [Sjcan 
be solved using Fourier transformation, which leads to 
the following power spectra for the signaling molecules. 
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Scheme Examples 



(I) 


S + W ^ X 


binding of ligands to receptors 

binding of enzymes to substrates 

binding of transcription factors to operator sites 


(11) 




post-translational modification 

activation of trans-membrane receptors followed by endocytosis 


(III) 


S^S + X, X^( 


^ coarse-grained models of enzymatic reactions 
regulation of gene expression 



TABLE 1: Three elementary detection motifs. Here, X is the output signal and S is the input signal; in motif I, W is the 

inactive (unbound) state of the detection component and X the active (bound) state. All these schemes have — > n S and 

S as a precursor to generate an input signal which fiuctuates about a steady state. For all the schemes, the mean output 
signal obeys c?{X) /dt = i^{5') — f^{X). A class of examples of detection motif II is the endocytosis of receptors such as the EGF 
receptors, which, upon ligand binding, are endocytosed together with the ligand |3^. 



S's(a;), and detection molecules, Sx{i^) , 

^s(^) = 5 ^ , 

(6a) 

. , , iv') (A^+u;^)+2A^(^77)-t-^^ je) 

5x(^) = 5 • 

(KI/-AAi)V(A2+2KI^ + ^2) ^2+^4 

(6b) 

In contrast to Eq. |21 Eq. |B1 takes into account the cor- 
relation between the noise in the external signal and the 
intrinsic noise of the processing unit. Importantly, if both 
K and (^77) are zero, then Eq. reduces to Eq. [3 

The correlations between extrinsic and intrinsic noise 
can have two distinct origins. Both are a consequence 
of the molecular character of the components; the corre- 
lations are thus unique to biochemical networks and ab- 
sent in electronic circuits. Wc will illustrate the sources 
of correlations using three elementary detection motifs, 
which are described in Tabled Tablc|21shows their power 
spectra and noise strengths. The motifs obey the same 
macroscopic chemical rate equation and have the same 
intrinsic noise. However, the noise in the input signals is 
transmitted differently. The differences between the mo- 
tifs are due to the different sources of correlations that 
are present. 

The first source of correlation between the extrinsic 
and intrinsic noise arises from the fact that the processing 
unit can act back on the input signal by directly affecting 
the number of signaling molecules; this corresponds to a 
non-zero value of k. This source of correlation is present 
in detection motif I, where it arises from the unbinding 
of signaling molecules from the detection molecules. For 
scheme 1, n = fi; the effect of this source of correlation 
on the noise in S and X depends upon the values of all 
the rate constants (see Eq. ^ and can either be negative 
or positive. The second possible source of correlation 
between the extrinsic and intrinsic noise is the correlated 
fluctuations in the number of signaling molecules and de- 
tection molecules, which arise from detection reactions 



that simultaneously change the number of both species; 
these correlated fluctuations are quantified via the cross- 
correlation function {^{t)ri{t')). This source of correla- 
tion is present in both schemes I and II, since each time a 
detection reaction fires, a signaling molecule is consumed 
and simultaneously a molecule of the processing module 
is produced (or activated). Additionally, for scheme I, 
the unbinding reactions also lead to cross-correlations in 
((t) and 7j{t). For scheme I, (^77) = -{v{S) + n{X}), 
while for scheme II, (^77) = —I'iS) ■ We emphasize 
that the sign of (^?/) is negative; the extrinsic and intrin- 
sic noise are thus anti-correlated. Eq.|Sl shows that these 
anti-correlated fluctuations can lower the noise in S and 
X. 

For detection motif III, both k and (^77) are zero. This 
scheme is the only one for which there is no correlation 
between the extrinsic and intrinsic noise. In motif III, 
the incoming signal catalyzes the activation of detection 
molecules. This reaction does not affect the signal in any 
way. The extrinsic and intrinsic noise are therefore un- 
correlated and the spectral addition rule, Eq.[21 holds. In 
this example the input signal relaxes mono-exponentially, 
so that the noise addition rule, Eq. ^ also holds. 



III. GENERAL PROCESSING MODULES AND 
MODULAR DESCRIPTION OF NOISE 
TRANSMISSION 

The systems discussed in the previous section consist of 
one component only. In appendix^ we derive the power 
spectra of the output signals of modules that consist of 
an arbitrary number of linear(ized) reactions; they are a 
generalization of Eq.|3 Here, we summarize the main re- 
sults and discuss how correlations between extrinsic and 
intrinsic noise affect a modular description of noise trans- 
mission through large networks. 

If the incoming signals of a module arc uncorrclatcd 
with each other and are processed via detection scheme 
III, then the power spectrum of the outgoing signal X^ is 
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Scheme Noise strength 



Noise power spectrum 



(I) 



(n + l)(A + ^) + 2i/ 
2 {Xf {n - l)p 



(S)2 (n + l)(A + /i) + 2i. 



S^iuj) = (S) 



S^LJ) = (X) 



(n + l)/j^A + (2;^ + (n + l)\)iu^ 

/i2A2 + (A2 + ^2 + i/2 + 2u{\ + fl))uj2 + LU* 

^i[\{2X + {n + + 2lo^] 

/i2A2 + (A2 + _^ + 2u{\ + H))UJ^ + LO'^ 



(11) 



2 /c.\ + 1 



2 2 ^ 2 (X)^ (n ^ l)fl 



(S)2 (n + l)(A + ^ + i.) 



(n + l)(A + ty) 

(A + Zy)2 +Lj2 



n - 1 



/i2 + (i)2 fl^ -\- LO^ n -\- 1 



Ss{io) 



(III) 



2 / c.\ + 1 



2 2,2 [X) 



(S)2 A + M 



(n + l)A 

A2 +Lj2 



TABLE 2: Exact solutions for the noise strengths and the noise power spectra, for the three detection motifs shown in TableQ 
in scheme I, the detection molecules W are assumed to be present in abundance. The noise strengths ctJ and correspond 
to the noise strengths of the input and output signal, respectively, and Ss{i^) and 5'x(<^) denote the respective power spectra. 
For all motifs, the intrinsic noise is af^ = (X) and the logarithmic gain g = dln{X) / dln{S) = (z^Z/i) {S)/{X). Only scheme 
III obeys the spectral and noise addition rules (see Eqs. |5|and0]l. 



given by 

Sx, (co) = 5£ (u;) + ^ {oj)Ss, {co). (7) 
j 

The first term on the right-hand side is the power spec- 
trum of the intrinsic noise in and g-^, {to) is the fre- 
quency dependent gain corresponding to input signal Sj . 

The gain gy^, {uj) is determined by the coupling between 
the network components (see appendixEJ, which, in gen- 
eral, relax multi-exponentially. A noise addition rule 
analogous to Eq.^jis therefore no longer obeyed. A spec- 
tral addition rule, Eq.[7| nevertheless still holds for these 
modules, because the extrinsic and intrinsic noise are in- 
dependent of one another - the input signals arc detected 
via motif III. Accordingly, the extrinsic contributions to 
the power spectrum of the output signal can be factor- 
ized into a function that only depends upon the intrinsic 
properties of the module, namely gy^,(uj), and one that 
only depends upon the input signal, Ssj{i^)- This allows 
a simple and modular description of noise transmission. 

If a module receives its input via detection scheme I or 
II, then correlations will be induced between the noise in 
the input signals and the intrinsic noise of the module. 
In this case, the spectral addition rule, Eq. [7| and hence 
the noise addition rule [25l break down. More impor- 
tantly, the correlations mean that the noise in the output 
signal of one module (which depends upon the intrinsic 
noise of that module) affects the intrinsic noise of another 
module. As a result, the intrinsic fluctuations of the 
different modules become correlated with one another; 
the modules therefore no longer perform independently 
of one another. This precludes a modular description of 
noise propagation, because the modules have to be ana- 



lyzed together at the mesoscopic level of the individual 
biochemical reactions. 



IV. ZERO-ORDER ULTRASENSITIVITY 

We illustrate the consequences of correlated extrinsic 
and intrinsic noise using the following push-pull network 
(see also Fig. Pl: 

Ea + W ^ EaW ^ Ea + X (8a) 
di 

Ed-hX^ EdX-^Ed + W (8b) 

Here, Ea is the activating enzyme that provides the in- 
coming signal and Ed is the deactivating enzyme; the 
substrate W is the unmodified component that serves as 
the detection component and X is the modified compo- 
nent that provides the outgoing signal. 

We have computed the noise in the output signal X 
for the push-pull network of Eq. |S1 The input signal 
Ea is modeled as a birth-death process, corresponding 
to (de)activation of Ea- The analysis has been per- 
formed using the linear-noise approximation |3ll | (sec Ap- 
pendix Q and its accuracy was verified by performing 
kinetic Monte Carlo simulations of the chemical master 
equation [s^ . We found that the analytical results 
are accurate to within 10%. Only at very high enzyme 
saturation, [WT]/[EaT] > 100, do the numerical results 
deviate significantly from the analytical results of the 
linear-noise approximation, because, in that regime, the 
fluctuations become are very large; this is due to the fact 
that, when the enzymes arc fully saturated, the behavior 
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.[W,1/[E^ 
^[W,1/[E^ 
^[W,1/[E^ 
.[W,1/[E^ 
.[W,1/[E^ 



^ 100 (noise addition; Eq. 4) 

= 100 (correlated extrinsic/intrinsic noise; Eq. 6) 

= 25 (noise addition; Eq. 4) 

= 25 (correlated extrinsic/intrinsic noise; Eq. 6) 

= 1 (noise addition; Eq. 4) 

= 1 (correlated extrinsic/intrinsic noise; Eq. 6} 



0.5: ^ & & a & & A a a 



FIG. 2: The noise of X, a^/ {X) as a function of d\/k\ = (^2/ ^2 
for a push-pull network for three different total substrate con- 
centrations [Wt] = [W] + [EaW]; [Ea,T] = [Ea] + [EaW] (see 
Eqs. [HI- In all cases, the Michaelis-Menten constants were 
kept constant at KM,Ea = Km,e^ = Km = 20 /jM. The hor- 
izontal sohd hnes correspond to the predictions of the noise 
addition rule (see Eq. 0J , while the dotted curves correspond 
to the results of the full analysis that takes into account the 
correlations between the extrinsic and intrinsic noise. Note 
that as the substrate concentration increases, the push-pull 
network moves deeper into the zero-order regime and the noise 
in the output signal X increases. However, the actual increase 
is significantly lower than that predicted by the noise addition 
rule. The smaller increase in the output noise is due to the 
anti-correlations between the noise in the input signal and the 
intrinsic noise of the push-pull network. The decay rate of the 
enzyme Ea is A = 30 fci , while the production rate is chosen 
such that [Ea] = [Ed] = 0.2 /iM. 



of the push-pull network resembles that of a system that 
is close to the critical point of a thermodynamic phase 
transition 

It is known that the noise in the output signal can 
increase as the biochemical reactions by which modules 
detect incoming signals become slower f37|. We have 
therefore varied the rate of binding and unbinding of the 
enzymes to their substrates. Fig. |21 shows the noise in 
the output signal as a function of the enzyme-substrate 
(un)binding rate, for different substrate concentrations; 
the ratios di/ki and ^2/^2 are varied such that the 
Michaelis-Menten constants i^M.a = idi + ki)/ai ~ 
Kyi.d = {d2 + fc2)/a2 = Km remain constant. We 
find that as the detection reactions become slower (lower 
di/ki), the noise in the output signal decreases, rather 
than increases. The reason for this, perhaps counter- 
intuitive, result is that the detection reactions not only 
provide a source of biochemical noise, but also act to 
integrate the fluctuations in the input signal. 

In the limit that both di ^ ki and d2 3> fc2, the 
(un)binding reactions of the enzymes to the substrates 
can be integrated out and the reaction scheme reduces to 



Ea 

Ed 



W^Ea 

X^Ed 



hX 
W 



(9a) 
(9b) 



In this limit, the signal Ea is detected via scheme III (see 
Tabled]); the modification and demodification rates are 
then given by Michaelis-Menten formulae |2^. However, 
even in this limit, the spectral addition rule does not 
necessarily apply (see Fig. , as has been suggested . 
Because the total amount of W and X together is con- 
served, fluctuations in X are anti-correlated with those 
in W and hence with those in the fraction of enzyme 
Ea that is bound to its substrate W. Since the bound 
enzyme is protected from deactivation, this effect will in- 
troduce anti-correlations between the fluctuations in the 
input signal Ea,T ~ the extrinsic noise - and those in 
the modification and demodification reactions - the in- 
trinsic noise (see appendix Q . This means that, even 
when di ^ ki and d2 3> ^2, the spectral addition rule, 
and hence the noise addition rule, only holds when the 
fraction of bound enzyme is negligible (see Fig. I^J. 

It is commonly believed that one of the main biological 
functions of push-pull networks is to turn a graded input 
signal into a nearly binary outp ut signal, thus allowing 
for an all-or-none response |27l 123 ] . The amplification 
of input signals in push-pull networks strongly increases 
with increasing enzyme saturation |23|. Fig.[5]shows that 
as the substrate concentrations are increased (and the en- 
zymes thus become more saturated with substrate), the 
noise in the output signal also markedly increases. This 
has been observed before the higher gain not 

only amplifies the mean input signal, but also the noise 
in the input signal, the extrinsic noise p^ : in addition, 
as the enzymes become more saturated with substrate, 
the intrinsic fiuctuations of the network also increase, 
because the network moves deeper into the zero-order 
regime |2^. Our results show, however, that the actual 
increase in the output noise is much lower than that pre- 
dicted by the noise addition rule. This is a result of the 
anti-correlations between the fluctuations in the input 
signal (Ea) and the intrinsic noise of the network. These 
anti-correlations between the extrinsic and intrinsic noise 
reduce the noise in the output signal, but are neglected by 
the noise addition rule. Moreover, they become more im- 
portant as the network moves deeper into the zero-order 
regime - as the enzymes Ea and Ed become more satu- 
rated with their substrates, the input signal Ea is increas- 
ingly being affected by its interaction with the detection 
component W of the network. While it is known that 
push-pull networks operating in the zero-order regime 
tend to exhibit large intrinsic fluctuations [l^ I29I I , our 
results show that anti-correlations between the extrinsic 
and intrinsic noise temper these fluctuations. 
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c^Mos-ZfMos*] 


kMEK-pp/[MEK-PP] 


kMAPK-pp/[MAPK-PP]| 


Fully coupled Mos, MEK and MAPK 


0.643 


1 90.3 


1 2.25 1 


Spectral addition rule; all uncoupled 


0.727 


1 168. 


1 3.75 1 


Coupled Mos and MEK; uncoupled MAPK 


0.643 


1 91.1 


1 2.26 1 


Coupled MEK and MAPK; uncoupled Mos 


0.727 


1 166. 


1 3.72 1 



TABLE 3: Noise in the Mos/MEK/p42 MAPK cascade (see Fig. [TJ. "Full noise" refers to results of the analysis, in which 
the transmission of noise was computed by studying all the biochemical reactions together. "Spectral addition" corresponds 
to the results of the recursive application of the spectral addition rule to all the successive layers; the layers are thus assumed 
to form independent modules. "Coupled Mos and MEK; uncoupled MAPK" refers to the results of an analysis, in which the 
first two layers were considered to form one module, while the third layer was assumed to form an independent module; the 
transmission of noise from the first to the second layer was thus computed by taking into account the correlations between the 
fluctuations in the output signal of the first layer, the concentration of active Mos, and the intrinsic noise of the second layer, 
the intrinsic fluctuations of MEK; in contrast, the transmission of noise from the second to the third module was calculated 
using the spectral addition rule, thus ignoring these correlations. "Coupled MEK and MAPK; uncoupled Mos" corresponds to 
the analysis in which the flrst layer was considered to be independent, while the last two layers were considered to form one 
module. Note that the correlations between the noise in active Mos and the intrinsic fluctuations of MEK strongly affect the 
transmitted noise. The concentrations are: [Mos] = 3 nM; [MEK] = 1200 nM; [MAPK] = 300 nM. See appendix for more 
details. 



V. MODULARITY AND THE MAPK CASCADE 

We show the implications of the correlations between 
the extrinsic and intrinsic noise for a modular descrip- 
tion of noise transmission in biochemical networks using 
a MAPK cascade that is based on the Mos/MEK/p42 
MAPK cascade of Xenopus oocytes. From a topological 
point of view, this network consists of three push-pull 
modules that are connected in series. Their key features 
are shown in Fig. ^ 

Active Mos can activate MEK through phosphoryla- 
tion at two residues, while MEK, in turn, can activate p42 
MAPK, also via double phosphorylation. The output sig- 
nal of each of the modules, which provides the input sig- 
nal for the next module in the cascade, is thus the active 
enzyme. We study here the network in which the feed- 
back from p42 MAPK to Mos has been blocked |35l39l|. 
The rate constants and the protein concentrations were, 
as far as possible, taken from experiments [l^jlHjUlj (see 
appendix IDl for details). All results have been obtained 
using the linear-noise approximations |3ll| . These ana- 
lytical results were found to be within 25% of numerical 
results of kinetic Monte Carlo simulations of the chemical 
master equation |35ll36l|. Appendix IDl describes in detail 
the linear-noise analysis. 

Table 13 shows the noise in the output signals of the 
three modules, as predicted by an iterative application of 
the spectral addition rule to the successive modules and 
as revealed by the analysis that takes into account the 
correlations between the fluctuations in the input signal 
of a module (which is the output signal of its upstream 
module) and the intrinsic noise of that module (see ap- 
pendix EJ. The spectral addition rule significantly over- 
estimates the propagation of noise; the noise in MAPK, 
the output signal of the cascade, is about 50% lower than 



that predicted by the spectral addition rule. This sup- 
ports our conclusion that anti-correlations between the 
extrinsic and intrinsic noise can enhance the performance 
of biochemical networks by making them more robust 
against biochemical noise. 

Table 13 also illustrates under which conditions modu- 
larity can be exploited for a coarse-grained description of 
noise transmission. "Coupled Mos and MEK; uncoupled 
MAPK" refers to the results of an analysis, in which it 
is assumed that the first two layers together form one 
module, while the third layer constitutes a second, in- 
dependent module. This analysis takes into account the 
correlations between the fluctuations in the output signal 
of the first layer - the concentration of active Mos - and 
the intrinsic fluctuations of the second layer - the noise in 
the modification and demodification reactions of MEK. 
However, it ignores the correlations between the output 
signal of the second layer and the intrinsic noise of the 
third layer. Similarly, "Coupled MEK and MAPK; un- 
coupled Mos" corresponds to the results of a description, 
in which the first layer forms one module, whereas the 
second and third layer form a second, independent mod- 
ule. We refer to appendix^for a mathematically precise 
description of the coupling between the respective layers. 

It is seen that while the "Coupled Mos and MEK; un- 
coupled MAPK" description is fairly accurate, the "Cou- 
pled MEK and MAPK; uncoupled Mos" description sig- 
nificantly overestimates the noise in the output signal of 
the cascade. This shows that while the correlations be- 
tween extrinsic and intrinsic noise are not very important 
for the transmission of noise from the second to the third 
layer, these correlations do strongly affect the propaga- 
tion of noise from the first to the second layer. This 
difference is due to the differences in enzyme saturation: 
active Mos is more saturated with its substrate, MEK, 
than active MEK is with its substrate, MAPK. As a con- 
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sequence, the signal that connects the first with the sec- 
ond layer (active Mos) is more affected by the detection 
reactions than that which connects the second with the 
third (active MEK). 



VI. DISCUSSION 

This analysis of the MAPK cascade unambiguously 
shows that correlations between the noise in the input 
signal of a network and the noise in the biochemical re- 
actions that constitute the network, will affect the noise 
in the output signal of that network. It also shows the im- 
plications for a coarse-grained description of noise prop- 
agation in biochemical networks that, from a topological 
point of view, appear to consist of functionally indepen- 
dent modules M2LM- 

From the perspective of noise transmission, a network 
can be decomposed into modules only if the signals that 
connect them are detected via chemical reactions that do 
not introduce significant correlations between the noise in 
these signals and the intrinsic noise of the modules. Each 
module then has a characteristic noise input-output re- 
lation (Eq. d) and this admits a modular description of 
noise transmission. The Mos-MEK/MAPK decomposi- 
tion of the MAPK cascade illustrates this: the trans- 
mission of noise from the Mos-MEK subnetwork to the 
MAPK subnetwork can be described at the level of two 
independent modules connected in series, because the de- 
tection reactions do not affect the signal that connects the 
modules. If, however, the correlations between the ex- 
trinsic and intrinsic noise are significant, then the noise 
input-output relations of the different subnetworks be- 
come entangled and they no longer perform indepen- 
dently of one another, as the Mos/MEK-MAPK parti- 
tioning shows. In these cases, the propagation of noise 
can only be quantified accurately if the correlated sub- 
networks are regrouped into independent modules. 

The effect of the correlations between the extrinsic and 
intrinsic noise is difficult to predict a priori. Our analyti- 
cal expression for the power spectrum of the output signal 
(see Eq. (B)) reveals that the effect on the noise in the out- 
put signal can either be positive or negative. This means 
that even if one would like to derive a lower or an up- 
per bound on the transmitted noise, one has to explicitly 
take into account the correlations between the extrinsic 
and intrinsic noise. The noise addition rule, which ne- 
glects the correlations, makes uncontrolled assumptions 
and should thus be used with care [2^ . 

In general, the importance of the correlations between 
the extrinsic and intrinsic noise for the noise transmis- 
sion is determined by the extent to which the signal is 
affected by the detection reactions. This increases when 
the concentration of the signaling molecules decreases 
with respect to that of the detection components (see 
Fig. 12). In zero-order ultrasensitive networks, the corre- 
lations are important, because the enzymes are saturated 
with substrate - the enzyme concentrations are thus low 



compared to the substrate concentrations. In gene regu- 
latory networks, correlations between the fluctuations in 
the concentrations of the gene regulatory proteins, the 
extrinsic noise, and the intrinsic noise of gene expres- 
sion, can contribute significantly to the transmission of 
noise through the network (to be published), because the 
concentrations of the gene regulatory proteins are often 
exceedingly low. The significance of the correlations be- 
tween extrinsic and intrinsic noise also increases when 
the binding affinity of the signaling molecules for the de- 
tection component increases and/or when the detection 
reactions become slower (see Fig. This is particu- 
larly important when weak signals have to be detected, 
as for example by the bacterium Escherichia coli, which 
can sense chemical attractants at nanomolar concentra- 
tion To be able to detect a weak signal, the pro- 
cessing network has to amplify the signal. This could be 
achieved by increasing the binding affinity of the signal- 
ing molecules. However, since the association rate cannot 
be increased beyond the diffusion-limited association rate 
constant, the only way to strongly increase the binding 
constant is to decrease the dissociation rate. As Fig. |2| 
shows, this will increase the importance of the correla- 
tions between the extrinsic and intrinsic noise. Corre- 
lations between extrinsic and intrinsic noise could thus 
impose strong design constraints for networks that have 
to detect small numbers of molecules. Lastly, we em- 
phasize that any mechanism that increases the gain of a 
processing network, potentially also amplifies the effect of 
the correlations between the extrinsic and intrinsic noise. 
An interesting case is provided by the flagellar rotary 
motors of E. coli |40l |. Recent experiments have revealed 
that the probability of clockwise rotation depends very 
steeply on the concentration of the messenger protein; 
the effective Hill coefficient is about 10 This means 
that the noise in the rotation direction (the output signal 
of that system) is likely to be affected by the binding and 
unbinding of the messenger protein to the motor |37l | and 
thus to the correlations between the fluctuations in the 
messenger protein concentration (the extrinsic noise) and 
the intrinsic fluctuations of the motor switching (intrinsic 
noise) . 

Finally, we believe that the predictions of our analy- 
sis could be tested experimentally by performing fluores- 
cence resonance energy transfer (FRET) or fluorescence 
correlation spectroscopy experiments on signal transduc- 
tion pathways [H, Hj. The MAPK cascade would be 
an interesting model system. By putting a FRET donor 
on MEK, and a FRET acceptor on both the enzyme of 
the upstream module, Mos, and that of the downstream 
module, MAPK, it should be possible to study the effect 
of correlations between extrinsic and intrinsic noise on 
the transmission of noise in signal transduction cascades. 

We thank Daan Frenkel, Bela Mulder, Rosalind Allen 
and Martin Howard for a critical reading of the 
manuscript. This work is supported by the Amsterdam 
Centre for Computational Science (ACCS). The work is 
part of the research program of the "Stichting voor Fun- 
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nancially supported by the "Nederlandse organisatie voor 
Wetenschappelijk Onderzoek (NWO)". 



APPENDIX A: GENERAL ANALYSIS 



In this approximation, the noise characteristics (correla- 
tion matrix H) do not depend anymore on the dynam- 
ical variables (here, x). The fluctuations of the vari- 
ables Xi are given by the correlation matrix C, where 



{XiXj I 



This correlation matrix can be obtained 



from the matrix equation |44 



We consider a general chemical network containing N 
species {Xi, X2, . . . , Xjv}- The state of the network is de- 
fined by the vector X = {Xi, X2, ■ ■ ■ , X^^, where Xi is 
the copy number of component Xi. The M reactions that 
constitute the network will be described by a propensity 
function A(X) and a stoichiometric matrix v% where v* 
denotes the change in the copy number of the species Xj 
due to reaction i. The reaction network dynamics can be 
modelled with a Chemical Master Equation, which de- 
scribes the evolution of the probability P(X, t) of having 
Xi molecules of type X, 

= f2 [A,(X - v^)P(X - V') - A{X)P{X)] 

(Al) 

Following j3^], the dynamics of the system can be ap- 
proximated in the limit of large number of molecules by 
a Chemical Langevin Equation (CLE) of the form: 



FC + CFT 



dX 
"dF 



E 

k=l 



v^-Afc(X)-|-e 



(A2) 



where ^ are Gaussian white noise terms of zero average 
and variance {(,i£_j) = S„- = I]feii v^Afe(X). Setting 
the noise terms to zero one obtains the "deterministic 
rate equation". The stable solutions of the equation 



M 



= ^v'^-A,(X) 



(A3) 



fc=i 



are usually a good approximation to the average values 
(X) obtained from Eq. lAll in the limit of large volume 
|3l| . One can further simplify Eq. IA2I by linearizing it 
around these solutions. One then obtains a set of linear 
stochastic differential equations for x = X — (X) . These 
represent the Linear Noise Approximation: 



N 



^F,jXj+S,^ VO<i<Af 



(A4) 



where 



M 
k=l 



dXi 



(A5) 



(A6) 



The method that we have used to estimate the mag- 
nitude of the fluctuations of the components in the 
networks discussed below, consists of two steps: first, 
we set the noise terms to zero in the CLE to obtain 
the steady-state solutions of the resulting deterministic 
rate equation; second, we compute the force matrix F 
and the noise correlations H in these points in order to 
obtain the correlation matrix C. In what follows, we 
will refer to the value of the matrix element C'a as the 
noise in component Xj. We have verified the accuracy 
of the Linear Noise Approximation for the problems 
discussed here by comparing the results with those of 
kinetic Monte Carlo simulations of the chemical master 
equation (Eq.|llJ HHH. 



APPENDIX B: GENERAL PROCESSING 
NETWORK AND MODULARITY 

Let us consider a linear(ized) reaction network of N 
components using the following set of Chemical Langevin 
Equations: 



M 



N 



Y,G^JSJ+Y.A,JXJ+^, VZ-1...7V. (Bl) 



Here, the components of the processing network 

and Sj denote the input signals. Aij are coefficients, 
are transmission factors, and ^ model the noise in the 
network components; we model them as Gaussian white 
noise of zero average and with (6i(t)Cj"(*')) = '^ijH^ ~ 
Crucially, in general, s depends upon the history of the 
values of the network components. Using the linearity of 
Eq. IB II the Fourier transform of the outputs X; can be 
found from an algebraic equation with solution 



N 



M 



.k=l 



, (B2) 



where the matrix B is given by B = (A + iu) . The 
corresponding power spectrum is: 
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N N M 

k,j — l jj—^ fc,m — 1 

AI 



+ EE^».H 



r 



(B3) 



Here, Cs^{uj) denotes the correlation between the input 
signal and the noise ^ in the frequency domain. The first 
term of the rhs of Ea. lB3l is the power spectrum of the in- 
trinsic noise of X.^ , while the second term is the spectrum 
of the signal Sj modulated by an intrinsic transfer func- 
tion. If the input signals are uncorrelated with each other 
((sfc(a')s*j(a;)) = SkmSs,,ii^)) and uncorrelated with the 
detection network (C's^(ti') = 0), Eg. IB3I reduces to 



M 



(B4) 



where S'x.(w) = Ylk.j=i Bli{(^)Bij{iu)Ejk is the intrinsic 
noise and g^, — ^2^1=1 Bij{uj)GjkGl.iBj-{u!) are intrin- 
sic transfer functions, both independent of the input 
signals. This is the spectral addition rule (Eq.7 of the 
manuscript) for a general linear(ized) reaction network 
that detects multiple input signals via detection scheme 
III. Importantly, in this case the power spectra of the in- 
put signals Ssi{oj) ~ {si{u))s*{Lo)) are unaffected by their 



interactions with the processing network; conversely, 
the intrinsic contribution to the power spectrum of X^, 
5x. (w), is a truly intrinsic quantity that depends upon 
properties of the processing module only, and not upon 
the fluctuations in the input signals, given by Ss^it-^)- 
However, if the input signals are correlated with each 
other and/or detected via scheme I and/or II, then 
the power spectra of the input signals and those of the 
network do mutually affect each other and the spectral 
addition rule breaks down. We emphasize that even 
when the input signals do not directly interact with the 
components that provide the output signals (as in the 
section ^J, but only indirectly via chemical reactions of 
the type of scheme I and II, then cross-correlations in the 
noise {^i^j) can be important, because their effects can 
propagate from the input signals to the output signals. 
From the perspective of noise transmission, a network 
can be decomposed into modules by cutting the network 
links that correspond to chemical reactions of the type 
in scheme HI. 



APPENDIX C: ZERO-ORDER ULTRASENSITIVE PUSH-PULL MODULE 



Let us consider the network: 













W ' 


♦ 


X 


W+Ea 


^ EaW ^ Ea + X 
dl 


w > 


♦ 


. X 








Ed 




X + Ed 


EdX ^ Ed + W 

d2 



The input signal is provided by the enzyme Ea. Its activation and deactivation dynamics is modeled as a birth-death 
process: 

^ Ea ^ (CI) 

Michaelis-Menten formulae can be derived by assuming fast equilibration of the complexes EaW and EdX. In order 
to self-consistently eliminate these intermediates, we split the independent variables into slow variables - those that 
do not change in the fast (un)binding reactions - and fast variables. We thus define the following slow variables: 
Wt = W4-EaW, Xt = X + EdX, Ea,T = Ea-l-EaW and Ed,T = Ed -I- EdX. The independent variables therefore are: 



X={X„X/}, Xs^{Ea,T,XT}, Xf^{EaW,EaX}. 



(C2) 
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We also use the conservation laws W + EaW + X + EdX = Y = constant and Ed + EdX = Ed^r- The values of the 
constants Y and Ed.T will appear as parameters in the dynamics of the network. For the full network, in the new 
variables, we have 



-A 


ai{W) -ai{Ea) 
a2Ed 



-di — ki 



A 

ki -k2 

~ai{W + Ea) 

~d2-k2-a2{X-Ed)_ 



, and 



(C3) 



k + X{Ea) 

„^ ki{Ea) + k2{EdX) -ki{EaW) k2{EdX) 

^ki{EaW) id,+ki){EaW)+ai{Ea){W) 

k2{EdX) {d2 + k2){EdX)+a2{Ed){X)_ 

In the limit of large (un)binding rates {a,d ^ fc), the copy numbers of the enzyme-substrate complexes can be 
expressed as a function of those of the slow variables 



Ea.T + Knn + {Y- Xt) - J{Ea,T + i^mi +Y- Xrf - 4 Ea.T {Y - Xt) 

EaW{XT,Ea,T) = — ^ ^ ' ^ " 



Ed,T + Km2 + Xt — \/iEd,T + Kai2 + Xt)^ — 4 Ed.T Xt 
EdX{XT,Ea,T) = ^ ■ . (C5) 

It is seen that the concentrations of the complexes depend on the rates a,; , di and ki only through the Michaelis- 
Menten constants i^mz = idi + ki)/ai. The network dynamics can be reduced to the simple form of a two-dimensional 
Chemical Langevin Equation, depending only on K„^i and fc^: 

dXr 

— ^ = fci EaW{XT, Ea.T) ~ ^2 EdX{XT, Ea,T) + &t (C6a) 

at 

= fc - A [Ea,T - EaW{XT, Ea,T)] + ^E.,,t (C6b) 



dt 

In order to compute the noise in the network components within the Linear Noise Approximation we use the matrices 



-A + A 



ki 



dEa T OXt 

dEaW{XT,Ea.T) 1, d E g X (Xt , E g .t) 7 dEaW{XT,Ea.T) 1, dEdX{XT,E^.T) 

' "^2 aT^ — ~ ' rCl am ' rCo ' 



dEa. 



dEa 



OXt 



dXr 



(C7) 



and 



k + X{Ea) 

ki{Ea) + k2{EdX) 



(C8) 



The prediction of the noise addition rule for the noise in Xt is obtained by setting the feedback Fi_2 to zero, such 
that 



■ NA 



, . ■.dEaW{XT,EaT) 

+ ^ dEi;^ — '~ 



ki 



dEaW{XT,Ea.T) 
dEa T 



c) E {^Xt ,E a t) 

dEa T 



ki 



dEaW{XT,Ea.T) 

OXt 



(C9) 



It is perha ps i nstructive to compare the approach presented here to that commonly employed for enzymatic reac- 



tions 123 



|29| . which would write the reactions for the push-pull network as: 



W X; ka 

kd 



kiEg^TW ^ 
W + K^i ' 



kd = 



k2Ed,TX 
X + 



(CIO) 
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Mos + El i=i EiMos El + Mos* 

dl 

Mos* + E2 ^ E2M0S* ^ E2 + Mos 

d2 

MEK + Mos* Mos*MEK Mos* + MEK-P 
da 

MEK-P + MEKP'ase ^ MEKP'aseMEK-P MEKP'asc + MEK 
MEK-P + Mos* ^ Mos* MEK-P Mos* + MEK-PP 

d5 

MEK-PP + MEKP'ase ^ MEKP'aseMEK-PP MEKP'ase + MEK-P 
de 

MAPK + MEK-PP ^ MEK-PPMAPK MEK-PP + MAPPK^ 

dj 

MAPK-P + MAPKP'ase ^ MAPKP'aseMAPK-P MAPKP'ase + MAPK 
da 

MAPK-P' + MEK-PP ^ MEK-PPMAPK-P MEK-^P + MAPPK-PP 

do 

MAPK-PP + MAPKP'ase MAPKP'aseMAPK-PP ^ MAPKP'ase + MAPK-P 

dio 



TABLE 4: Reactions in the MAPK cascade. 



A connection can be made by noting that, when the binding and unbinding of the enzymes to the substrates is fast, 
EaW = Ea^rW / [K-^-^ i + W) and E^X = £'d.T-'^/(-K^m,2 + it can be verified that these expressions are equivalent 
to those for EaW and EdX in Eg. IC5I However, the principal difference between our approach and that presented 
in pSl26ll2^ is that we analyze the dynamics of Ear and Xt together, thus taking into the fact that the fluctuations 
in Xt can act back on those in EaT- If the fraction of enzyme Ea that is bound to its substrate, W, is small, then 
the importance of the third term in Eg. IC6bl finvolving the complex EaW) is small. In this limit, the results of the 
full analysis, which takes into account the correlations between the extrinsic and intrinsic noise, reduces to those of 
the spectral addition rule (see Fig. 



APPENDIX D: MAPK CASCADE 

We model the Mos/MEK/p42 MAPK cascade as a network consisting of 10 enzymatic reactions [s^l; these are 
listed in Table H 

Since the association and deassociation rates (a^ and d^, respectively) have not been measured experimentally, we 
consider the limit of fast binding and unbinding. We are thus interested in the dynamics of the slow components: 

Most = Mos* -I- E2M0S* -f- Mos*MEK -I- Mos*MEK-P 

MEK-Pt = MEK-T- -t- Mos*MEK-P -f MERr'aseMEK-P 

MEK-T-Pt = MEK-T-P + MEKP'aseMEK-PP + MEK-P-PMAPK + MEK-PPMAPK-P 

MAPK-Pt = MAPK-P + MEK-PPMAPK-P + MAPKP'aseMAPK-P 

MAPK-PPt = MAPK-PP MAPKP'aseMAPK-PP (Dl) 

We use the conservation laws: 

Ei.T = El -I- EiMos = constant 

Most = Mos^ + Mos -t- EiMos = constant 

E2.T = E2 -|- E2M0S* = constant 

MEKt = MEK^T + MEK-PPt + MEK + Mos* MEK = constant 

MEKP'asex = MEKP'asc + MEKP'aseMEK-P + MEKP'aseMEK-PP = constant 

MAPKt = MAPK -h MAPK-Pt + MAPK-PPt + MEK-PPMAPK = constant (D2) 

MAPKP'ascT = MAPKP'ase + MAPKP'aseMAPK-P + MAPKP'aseMAPK-PP = constant 
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For the slow variables, the Chemical Langevin Equations read: 

^Mos^ = kiEiMos ~ k2E2Mos* + £,1 

^MEK-Pt = k:iMos*MEK -UMEKP'aseMEK-P- 
at 

k^Mos*MEK-^ + keMEKP'aseMEK-^P + ^ 

^MEK-PPt ^ k5Mos*MEK-P'-keMEKP'aseMEK-P'P + ^3 
dt 

—MAPK-P't = kjMEK-P^PMAPK - kg,M AP K P' aseM AP K-P - 
dt 

kgMEK-PPMAPK-^ + kwMAPKP'aseMAPK-PP + ^4 
^MAPK-P-Pt = kgMEK-^PMAPK-^ - k^MAPKP'aseMAPK-P'P + (5 (D3) 

where the noise terms ^, as discussed above, are modeled as Gaussian white noise of zero mean and variance: 

(^f) = kiEiMos + k2E2Mos* 

{Q = k3.Mos*MEK + kiMEKP'aseMEK-P' + 

kr,Mos*MEK-^ + keMEKP'aseMEK-^P 
(^l) = k5Mos*MEK-P + keMEKP'aseMEK-PP 
(^l) = krMEK-^PMAPK + ksMAPKP'aseMAPK-P + 

kgMEK^PMAPK-P + kioMAPKP'aseMAPK-PP 
(^2) kgMEK-P^PMAPK-P + kioMAPKP'aseMAPK-PP (D4) 



All the noise terms are uncorrelated, except: 



(66) = - {k5Mos*MEK-P' + keMEKP'aseMEK-P'P) 
(66) = - {kgMEK-PPMAPK-P + kwMAPKP'aseMAP) (D5) 

The noise correlations (66) define the elements of the matrix H. 

The dependence of the intermediate complexes EiMos, E2M0S*, Mos*MEK, Mos*MEK-P, MEKP'aseMEK-T", 
MEKP'aseMEK-T-P, MEK-TTMAPK, MEKT-PMAPK-P, MAPKP'aseMAPK-P, and MAPKP'aseMAPK-PP on the 
slow variables around the steady state, has been obtained numerically. The concentrations of the complexes depend 
on the reaction rates only through the Michaelis-Menten constants Kn^i = {di + ki)/ai. 

We can now construct, as explained in section ^ the force matrix F of the Linear Noise approximation and use F 
and H as defined in Eas. ID4l and ID5l to numerically solve Eq. IA6I 

The MAPK network consists of three layers. Here we address the question to what extent these can be described 
as three independent modules. To this end, wc divide the full network into subnetworks, in three different manners: 



1. {Mos^} {MEK-Pt, MEK-PPt} {MAPK-Pt, MAPK-PPt} 

2. {Mos^,MEK-Pt,MEK-T'Pt} {MAPKPt, MAPKPPt} 

3. {Mos^} {MEK-Pt,MEK-PPt,MAPK-P't,MAPKPPt} (D6) 

The network numbered 1 consists of three uncoupled layers; that numbered 2 consists of one module in which the Mos 
and the MEK layer are coupled, while the MAPK layer is assumed to form a second, independent module; network 3 
consists of one module in which layers 2 and 3 are concatenated and one, uncoupled, module formed by layer 1. 

To study the effect of the correlations between the extrinsic and intrinsic noise, it is instructive to define submatrices, 
Fii, Gij [i > j), and Kij {i < j) of the matrix F of the full network. These matrices are defined as follows: 



Fii 


K12 


Ki3 




G21 


F22 


K23 


= F 


G31 


G32 


F33 





14 



Most 


MEKt 


MAPKt 


El,T 


E2,T 


MEKP'aseT 


MAPKP'aseT 


3 


1200 


300 


0.1 


0.6 


0.6 


300 



TABLE 5: Total concentrations of the components (nM) 



The three decompositions of the fuU network then correspond to the following force matrices: 









Fii 








1 


Spectral Addition; All Uncoupled 


Fi = 


G21 


F22 











L 


G32 


F33 








^Fii 


K12 





2 


Coupled Mos and MEK; Uncoupled MAPK 


F2 = 


G21 


F22 














G32 


F33 








Fii 








3 


Uncoupled Mos; Coupled MEK and MAPK 


F3 = 


G21 


F22 


K23 











G32 


F33 



(D8) 

Here, is the null matrix. 

The noise matrix H of the full network is already partitioned into the different modules. For all partitionings, the 
noise matrix is thus given by Eas. ID4l and ID5l 

The relevant model parameters are the total concentrations on the rhs of E a.lD3lan d the Michaelis-Menten constants. 
The concentrations were taken from the experiments discussed in [2^ I2M l38l l45| and are shown in Table |31 The 
Michaelis-Menten constant of the MAPK activation by MEK has been measured experimentally [i^. Following 
[3^ . we take all Michaelis-Menten constants to be equal to K^^i = Km = 300 nM. The ki values were taken to be 
equal to each other; their absolute value is not important for the calculations here, because it only sets the time scale 
in the problem. 
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